Mexicali
Crafting Large Language Models for Enhanced Interpretability
Sun, Chung-En, Oikarinen, Tuomas, Weng, Tsui-Wei
We introduce the Concept Bottleneck Large Language Model (CB-LLM), a pioneering approach to creating inherently interpretable Large Language Models (LLMs). Unlike traditional black-box LLMs that rely on post-hoc interpretation methods with limited neuron function insights, CB-LLM sets a new standard with its built-in interpretability, scalability, and ability to provide clear, accurate explanations. This innovation not only advances transparency in language models but also enhances their effectiveness. Our unique Automatic Concept Correction (ACC) strategy successfully narrows the performance gap with conventional black-box LLMs, positioning CB-LLM as a model that combines the high accuracy of traditional LLMs with the added benefit of clear interpretability -- a feature markedly absent in existing LLMs.
An Ontological Representation Model to Tailor Ambient Assisted Interventions for Wandering
Rodriguez, Marcela (Autonomous University of Baja California) | Navarro, Rene (Centro de Investigación Científica y de Educación Superior de Ensenada) | Favela, Jesus (Centro de Investigación Científica y de Educación Superior de Ensenada) | Hoey, Jesse (University of Waterloo)
Wandering is a problematic behavior that is common among people with dementia (PwD), and is highly influenced by the elders’ background and by contextual factors specific to the situation. We have developed the Ambient Augmented Memory System (AAMS) to support the caregiver to implement interventions based on providing external memory aids to the PwD. To provide a successful intervention, it is required to use an individualized approach that considers the context of the PwD situation. To reach this end, we extended the AAMS system to include an ontological model to support the context-aware tailoring of interventions for wandering. In this paper, we illustrate the ontology flexibility to personalize the AAMS system to support direct and indirect interventions for wandering through mobile devices.